Papers with human rationale annotations
Being Right for Whose Right Reasons? (2023.acl-long)
Copied to clipboard
| Challenge: | Existing work has failed to acknowledge that what counts as a rationale is subjective. |
| Approach: | They propose to use demographic annotations to augment existing datasets to ask what demographics our models align with and whose reasoning patterns they align with. |
| Outcome: | The proposed model rationales align better with older and/or white annotators, and are biased towards older and white anorators. |